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(57) A multiplication means (51) memorizes a 
series of optical density figures representing a 
series of orthogonal function patterns and per- 
forms optical multiplications upon an original 
picture in comparison with each of the ortho- 
gonal function patterns. A summation means 
(52) determines the expansion coefficients of 
the orthogonal functions for the whole original 
picture from the operation results obtained by 
the multiplication means (51). A quantizing and 
encoding means (53) quantizes and encodes 
the orthogonal function expanding coefficients 
obtained by the summation means (52) for com- 
pressing the data. The encoded data is transmit- 
ted to a picture restoring section which has the 
same optical system as the picture compressing 
section. This enables the system to conduct 
two-way picture encoding and restoring. 
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BACKGROUND OF THE INVENTION 

The present invention relates to a picture compressing and restoring system and a method for forming a 
pattern to be recorded inside a spatial light modulator and, more particularly, to a picture compressing and 
restoring system capable of optically compressing and restoring a picture, and is applicable to image processing 
e.g., video phones, TV conferencing etc. 

Today's information-oriented society requires the transmission and storage of pictorial data, including a 
large amount of information, as the most important function of the information age. In processing digitized still- 
pictures and data it is very difficult to record and transmit a large amount of pictorial data via the existing storage 
and digital networks. For example, a picture of an A4-sized format includes information of about 26 Mbytes 
(300 dpi) and one picture on a TV display contains the data of about 30 Mbytes. Accordingly, pictorial data must 
be compressed by an encoding means prior to recording and transmitting it. 

A variety of systems have been proposed for encoding pictorial data and for standardizing the encoding 
system. Efforts have been made to make the existing media mutually connectable and compatible. In Decem- 
ber of 1 990, CCITT recommended the system H.261 for encoding the moving pictures of video phones and at 
TV conferences. At the end of 1992 JPEG (Joint Photographic Experts Group), a joint session of CCITT and 
ISO (International Organization of Standardization) recommended that the colored still Picture- encoding sys- 
tem be standardized. MPEG (Moving Picture Experts Group) of ISO now is engaged in examining systems for 
encoding moving pictures to be played on VTR systems, and has standardized the encoding system MPEG 
by which data transmission is carried out at the rate of not more than 1 .5 Mbits per second. 

DOT (discrete cosine transform) is explained as follows: (The detail of DOT is described in a handbook on 
television and pictorial information engineering published by the Ohm Company, Japan, Nov. 30, 1 990, pp.11 5- 
133, pp.409-413.) 

An analog picture is digitized through standardizing and quantizing processes. The standardizing operation 
is to array picture elements (sampling points) on the picture to get a representation of a variety of luminance 
of the arrayed picture elements, and a quantizing operation to transform the luminous value of each picture 
element into the corresponding one of eight luminance levels previously created. The compression of the digital 
pictorial data may be accomplished by any of two methods: the first one is a reversible encoding method al- 
lowing for the complete reproduction of the initial digital picture from the compressed data, and the other one 
is an irreversible encoding method permitting a certain degree of image distortion at the reproduction end of 
the initial digital picture from the compressed data. The irreversible coding method can compress the data more 
densely than the reversible method. The typical make up of the irreversible coding system is such that a digital 
picture is put into a preprocessing unit wherein it is subjected to filtering for reducing its redundancy and then 
it is coarsely quantized according to the required picture's quality and coefficiency of the data's compression. 
The quantized output is reversibly coded by, for example, the Huffman encoding method. 

The most generally used technique for creating irreversible coding is an anticipatory coding or conversion 
coding. The conversion coding is effective in the case where a reproduced picture may have a relatively low 
quality i.e. sampled values are converted to orthogonal coordinates and thereby effective coding is realized 
by eliminating the correlation of the sampled values. In practice, a picture is divided into small Blocks com- 
prising N picture elements x M lines each of which are separately converted to corresponding values of an 
orthogonal coordinating system. The conversion coefficient varies with the frequency components in the range 
from a direct current to a high frequency. Power concentration is normally observed at the low-frequency com- 
ponents. Accordingly, many bits are distributed to the low-frequency components with due consideration of 
their visual characteristics while the high-frequency components are coarsely quantized with a lesser number 
of bits. This reduces the total number of bits for coding. 

The orthogonal transformation is featured basically by the concentration of energy at low-frequency com- 
ponents and reflection of edge and line information on high-frequency components. Walsh-Hadamard trans- 
form and DCT relate to the orthogonal transformation. DCT is applied with two-dimensional compression of 
the pictorial data. Sequential transformation and inverse transformation of two-dimensional DCT are ex- 
pressed respectively by the following equations (1),(2): Normal transformation 
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C; Transformation coefficient 

An image reproducing system with an array of flat micro-lenses and Walsh's orthogonal expansion system 
of parallel images, which has Walsh's two-dimensional functional mask, are proposed by Akiba etal. The "Fun- 
damental study of a micro-optical image preprocessing system using an array of flat micro-lenses", Optics vol. 
20, No.8, pp.507-513, August, 1991 . The system proposed therein is intended to employ a method of treatment 
using binary imaged character information and comprises of an array of flat micro-lenses, Walsh's functional 
mask and a CCD camera. An input image is used and a numerical character pattern is adhered to a diffusion 
plate to be illuminated by transmitting incoherent light from behind. One of the arrayed flat micro-lenses causes 
rays of light from the input image to meet together at the principal focus to form a real image. The pattern of 
the rays of light of this image then pass through a series of Walsh's functional masks and converge at a CCD 
camera and are recorded in an image memory of a computer wherein the light pattern is quantized by a sum- 
mation on every pixel value. The Walsh's expansion coefficients are determined by subtracting the transmitted 
light intensity values corresponding to positive and negative portions of Walsh's functions. 

The publication of the unexamined patent application, JP, A, 57-10123 discloses a light source system 
which is basically composed of a light source, two acoustooptical modulators, a Fourier transforming lens and 
a detecting means and which is intended to make a cosine transformation by using a Fourier transform lens 
for tight wave transformation. ** : 

In contrast to the above, a device according to the present invention, does not require the use of two acous- 
tooptical modulators and a Fourier transform lens and is capable of executing a discrete cosine transformation 
according to ON- and summations by means of a converging lens and a mask (spatial filter) which substitutes 
a basic pattern of a discrete cosine transformation through a variety of transmission. 

The publication of the unexamined patent application, JP, A, 2-120917 discloses an optical hybrid arith- 
metic unit which is basically composed of a one-dimensional spatial optical modulator, a two-dimensional spa- 
tial light modulator (a spatial filter for discrete cosine transformation meaning a mask with a constant pattern 
not requiring rewriting), a one-dimensional photoelectric converter, a light source, an optical system for the two- 
dimensional spatial optical modulator and an optical system for converging to the one-dimensional photoelec- 
tric converter. This unit divides a two-dimensional image into picture elements in a vertical or horizontal direc- 
tion and treats a line or column of one-dimensional images as an input signal as well as an output signal. The 
unit performs sequential calculations on each line (or column) of and lines (or columns) of pixcels of the two- 
dimensional image thereby causing the problem of time-consumed operations. 

The device according to the present invention comprises a two-dimensional spatial light modulator (e.g. 
a liquid crystal panel) and a two-dimensional photoelectric converter (e.g. a charge-coupled device) instead 
of the one-dimensional spatial light modulator and the one-dimensional photoelectric converter of the prior art. 
This device treats a two-dimensional image itself as an input signal as well as an output signal and can execute 
a discrete cosine transformation of the two-dimensional image itself at one time thereby ensuring high-speed 
processing. 

The publication of the unexamined patent application, JP, A, 2-127625 discloses a unit for light discrete 
cosine transformation and an image-cording device using a unit which is basically composed of a two-dimen- 
sional photoelectric converter, a first-optical system for sampling real parts of a two-dimensional Fourier trans- 
formation, a second optical system for sampling cosine terms and a photoelectric converter. The device is in- 
tended to execute a cosine transformation by using a Fourier transform lens for effecting light wave transfor- 
mation. 

In contrast to the above mentioned prior art, the device according to the present invention, does not require 
complex optical systems for sampling real parts of a two-dimensional Fourier transformation and for sampling 
cosine terms and can execute a discrete cosine transformation on the basis of ON- and summations by means 
of a converging lens and a mask (spatial filter) which substitutes a basic pattern of a discrete cosine transfor- 
mation by a variety of transmission. 

As mentioned above, the conventional pictorial data encoding/decoding system utilizes the coding method 
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based on "discrete cosine transform", which is featured by the relatively low compressibility of the information 
and complicated structure of the processing system (since a picture is divided into blocks), neighbours of which 
are generally related with each other and which are separately processed. Since the block processing also 
causes a restored picture to have block separating lines thereon, it is necessary to remove said lines from the 
5 picture by using a post- processing filter which is very hard to design and manufacture and that has a high qual- 
ity and excellent performance because of its dependence upon the picture content. 

SUMMARY OF THE INVENTION 

10 It is an object of the present invention to provide a picture compressing and restoring system which is based 

on the method of total picture processing by high-speed parallel optical operations that eliminate the neccessity 
of using a post-processing filter for the conventional system based on the orthogonal transforming method 
by use of a digital computer. 

It is another object of the present invention to provide a method for forming patterns to be recorded in a 

15 spatial light modulator used in the proposed system. 

It is another object of the present invention to provide a picture compressing and restoring system which 
can totally process a picture having mutually relating neighboring portions without dividing it into blocks and 
thereby attain a higher level of information compression and a simpler construction in comparison with any 
conventional system obtaining the same image quality. 

20 It is another object of the present invention to provide a picture compressing and restoring system which 

can restore the original picture with no block separating lines to eliminate the need of a post-processing filter 
which is required for removing the block separating lines in the conventional system and is hard to design and 
manufacture with excellent characteristics because it may be affected by the picture's content to be processed. 
It is another object of the present invention to provide a picture compressing and restoring system which 

25 is based on the high-speed parallel optical information processing utilizing the characteristic of the light and 
can be manufactured at a very low cost by developing high accuracy optical components such as micro-lens 
arrays, spatial light modulators and so on, with due consideration that any conventional picture compressing 
method based on orthogonal transformation by using an existing digital computer which is required to execute 
mathematical operations at very high speeds and makes the system expensive. 

30 It is another object of the present invention to provide a picture compressing and restoring system which 

is capable of compensating distortion and optical axis displacement of an original picture projected through 
micro-lens array onto each of orthogonal function patterns recorded in a spatial light modulator for orthogonal 
transformation by previously multiplying each orthogonal function pattern by an inverse value of the transmis- 
sion characteristic of each corresponding micro-lens so as to reduce the accuracy requirement of the micro- 

35 lenses (it is technologically difficult to make an array of micro-lenses all having the ideal distortion-free trans- 
mission characteristic) and simplifying the manufacture of the micro-lens array. 

A time multi-expanding method is to perform multiplications upon an original picture in comparison with 
each of the orthogonal function patterns recorded in a spatial light modulator for orthogonal transformation 
and sequentially extract expansion coefficients of the orthogonal functions in the direction of the time base. 

40 The expansion coefficients are quantized and encoded and thus compressed data is transmitted to a picture 
restoring section wherein a restored picture is obtained: 

A space multi-expanding method is to project an original picture through a two-dimensional lens array onto 
each of the orthogonal functional patterns recorded in a mask for orthogonal transformation and perform mul- 
tiplications on the original picture in comparison with all recorded patterns at the same time. Expansion coef- 

45 f icients of orthogonal functions are determined by an array of light receiving elements and are quantized and 
encoded, thereby the compressed data is transmitted to a picture restoring section. 

A time-and-space multi-expanding method is to project an original picture through a two-dimensional lens 
array onto each of the orthogonal function patterns recorded in a light modulator for orthogonal transformation 
and perform parallel and sequential multiplications upon the original picture in comparison with all the recorded 

so patterns. Expansion coefficients of the orthogonal functions are determined by an array of light receiving ele- 
ments and are quantized and encoded. Then the compressed data is transmitted to a picture restoring section. 

The above-mentioned three methods provide a two-way type picture compressing and restoring system 
by applying the same types of optical systems in to their picture compressing sections and picture restoring 
sections. 

55 

BRIEF DESCRIPTION OF DRAWINGS 

Fig.1 is a flow chart showing the processing operation of a conventional picture encoding and decoding 
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system. 

Fig. 2 is a view showing the basic picture of a conventional two-dimensional discrete cosine transform 
(DCT). 

Fig. 3 is a view for explaining a conventional two-dimensional DCT. 
5 Fig.4 is a block diagram for explaining the construction of a picture compressing and restoring system em- 

bodying the present invention. 

Fig. 5 is a view for explaining a time multi-expanding type picture compressing and restoring system ac- 
cording to the present invention. 

Fig.6 is a view for explaining a space multi-expanding type picture compressing and restoring system ac- 
w cording to the present invention. 

Fig.7 is a view for explaining a time-and-space multi-expanding type picture compressing and restoring 
system according to the present invention. 

PREFERRED EMBODIMENT OF THE INVENTION 

15 

The present invention will now be described in detail by way of example with reference to the accompanying 
drawings. 

The above-mentioned recommended or standardized systems for encoding pictorial data divide an original 
picture 1 into small blocks of 8 x 8 elements 2 each as shown in Fig.1 and apply two-dimensional orthogonal 
20 transformations (discrete cosine transform) on each block to reduce the spatial redundancy of the pictorial data 
and obtain therefrom coefficients 3, among which 3a is a large value, 3b is a small value and 3c is a very small 
value. When encoding a moving picture, these systems reduce the time redundancy of the picture information 
by detecting its movement and by using the data on said movement. 

Since the above-mentioned conventional techniques for encoding and restoring pictures are based on the 
25 existing digital processing methods and are limited by the processing speed of the computer to be applied, it 
is necessary to divide a picture into a number of smaller picture blocks and to process each of them. 

In Fig.1, there is shown a conventional system for encoding and restoring pictorial data as an example of 
an internationally standardized processing. For instance, a whole picture consisting of 500 elements in rows 
and 700 elements in columns is divided into proper squares of 8 x 8 elements each. Each block is subjected 
30 to discrete cosine transform (DCT) by using a two-dimensional DCT basic mask shown in Fig.2 and then highly 
significant portions having high coefficients of DCT are encoded and transmitted as shown in Fig. 3. 

In a picture restoring section, the values transmitted from the compressing section are decoded into the 
initial DCT coefficients 4 (4a is a large value and 4b is a small value and 4c is a zero value) and an intermediate 
picture comprising square blocks of 8 x 8 elements each is obtained by using a previously prepared set of a 
35 cosine series. The intermediate picture 5 is subjected to filtering by a post-processing filter to remove the lines 
separating the blocks of the reproduced picture. The original picture 6 is thus restored. 

For orthogonal transformations by this encoding system many operations (multiplication and summation) 
must be performed. Accordingly, high-speed processing is required to encode or restore a moving picture in 
real time. The standardized system for encoding and restoring pictorial data provides only a basic sequence 
40 of picture encoding and does not include pre- processings and post-processings e.g. filtering for improving the 
picture quality. 

Referring now to the accompanying drawings, the preferred embodiments of the present invention will be 
described in detail as follows: 

Fig.4 is a schematic diagram of a picture compressing and restoring system embodied in the present in- 
45 vention, which comprises a picture compressing section 11, a multiplication means 12, a summation means 
13, a quantizing and encoding means 14, a picture restoring section 15, a decoding and inverse quantizing 
means 16, an optical (light) density picture obtaining means 17, a multiplication means 18 and a summation 
means 19. 

The multiplication means 12 (Light modulator for orthogonal transformation, a Mask for orthogonal trans- 
so formation), memorizes a series of optical density figures representing a series of orthogonal function patterns 
and performs optical multiplications upon an original picture in comparison with each of the orthogonal function 
patterns. A summation means 13 (Condenser lens, Light-receiving element, an array of light- receiving ele- 
ments) determines the orthogonal function expanding coefficients from the results of the operations made by 
the multiplication means 12. Aquantizing and encoding means 14 quantizes and encodes the orthogonal func- 
55 tion expanding coefficients obtained by the summation means 13. The above-mentioned multiplication means 
12, summation means 13 and the quantizing and encoding means 14 compose a picture compressing section 
11. The decoding and inversely quantizing means 16 decodes a sequence of data encoded by the picture com- 
pressing section into the orthogonal function expanding coefficients. The optical density picture obtaining 
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means 17 provides optical density pictures with a uniform brightness in accordance with the values of the or- 
thogonal function expanding coefficients obtained by the decoding and inverse quantizing means 16. The mul- 
tiplication means 1 8 (Light modulator for orthogonal transformation, Mask for orthogonal transformation) con- 
ducts multiplications upon the optical density picture obtained by the optical density picture obtaining means 

5 17 in comparison with the recorded orthogonal function patterns that get images of picture elements corre- 
sponding to the orthogonal function expanding coefficients. The summation means 1 9 (Two-dimensional array 
of lenses, Screen) optically superimposes the images of the picture elements on each other. The above- 
mentioned decoding and invese quantizing means 16, optical density picture obtaining means 17, the multi- 
plication means 18 and the summation means 19 make up a picture restoring section 15. 

10 The present invention provides three of the following type picture compressing and restoring systems: 

(1) Atime multi-expanding type that expands the orthogonal function expansion coefficients on a time ba- 
sis; 

(2) A space multi-expanding type that expands the orthogonal function expansion coefficients on a two- 
dimensional plane. 

15 (3) A time-and-space multi-expanding type that expands the orthogonal function expansion coefficients 

both on a time base and a two-dimensional plane. 
The above-mentioned methods will be described each as follows: 

Figure 5 is a schematic diagram of an example of a time multi-expanding type picture compressing and 
restoring system embodying the present invention, which includes a light source 21, a liquid crystal television 

20 display (LCTV) 22, a spatial light modulator (SLM) 23 for orthogonal transformation, an orthogonal function 
writing device 24, a condenser lens 25, a light-receiving photodiode (PD) 26, a quantizer 27, an encoder 28, 
a decoder 29, an inverse quantizer 30, a light-emitting diode (LED) 31, a condenser lens 32, an orthogonal 
function writing device 33, a spatial light modulator (SLM) 34 for orthogonal transformation, a screen 35 and 
an observation point 36. 

25 The time multi-expanding type picture compressing and restoring system comprises a picture compressing 

section and a picture restoring section and can obtain all of the orthogonal function expanding coefficients 
within a certain duration of time by performing optical multiplications upon a picture projected on a series of 
orthogonal functional patterns renewable with time by means of a spatial light modulator which is capable of 
fast rewriting function patterns. 

30 The picture compressing section is composed of a light source 21 , a liquid crystal TV display 22, a spatial 

light modulator for orthogonal transformation (an optical multiplication portion) 23, an orthogonal function writ- 
ing device 24, a condenser lens 25, a light-receiving element 26, a quantizer 27 and an encoder 28. The con- 
denser lens 25 and the light-receiving element 26 make up an optical summation portion. An original picture 
(of a giant panda in the shown case) as a video signal of NTSC (National Television System Committee Color 

35 System) is input to the liquid crystal TV display 22 and illuminated from the back by the light source 21. Or- 
thogonal function patterns in the form of varied optical density figures are written serially by the orthogonal 
function writing device 24 into the spatial light modulator 23 for orthogonal transformation. Optical multiplica- 
tions are carried out upon the original picture on the liquid crystal TV display 22 in comparison with each of 
the orthogonal function patterns to extract therefrom corresponding expansion coefficients in the time base 

40 direction which is then input into the light-receiving element 26 through the condenser lens 25. The light- 
receiving element 26 and the condenser lens 25 compose the optical summation device. The analog signal 
input into the light receiving element 26 is converted to a digital signal which is quantized and encoded. The 
spatial light modulator 23 for orthogonal transformation must have an ultra-high response (-nsec). The encoder 
28 compresses data by distributing shorter codes to frequently occurring symbols and longer codes to less 

45 occurring symbols. Huffman encoding is applied in this case. 

The picture restoring section is composed of a decoder 29, an inverse quantizer 30, a light-emitting element 
31 , a condenser lens 32, an orthogonal function writing device 33, a spatial light modulator 34 for orthogonal 
transformation and a screen 35. In this section, the encoded data serially and electrically transmitted from the 
picture compressing section are decoded and restored into corresponding expansion coefficients of the or- 

50 thogonal functions by the decoder 29 and the inverse quantizer 30. The light-emitting element 31 emits light 
depending upon a value of each expansion coefficient and forms a light source surface with the condenser 
lens 32. Optical multiplications are carried out upon the light source surface in comparison with each of the 
orthogonal function patterns corresponding to the orthogonal function expanding coefficients serially written 
into the spatial light modulator 34 by means of the orthogonal function writing device 33. The results of the 

55 operations are time multiplexed and superimposed on each other to reproduce a picture corresponding to the 
original which can be observed by human eyes 36 on the screen 35. 

The time expanding method requires a high-speed response (high rewriting speed) of the spatial light mod- 
ulators 23 and 34 to assure the time-base expansion of the coefficients (series) of orthogonal functions rep- 
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resenting a picture. For example, when an original picture consists of 640 horizontal pixels and 480 vertical 
pixels and has a duration of 30 msec, it must have 326 and 400 expansion coefficients of the orthogonal func- 
tions. To obtain all of the above mentioned coefficients the spatial light modulators 23 and 34 are required to 
have a response speed of about 0.1 jisec. However, if the number of the orthogonal function expansion coef- 

5 ficients can be reduced to 1/10 (by cutting off HF components), the required response speed of the spatial 
light modulators 23 and 34 decreases to about 1 usee. 

When an original picture image on the liquid crystal TV display 22 and the restored picture image on the 
screen 35 are of the same magnification (i.e., 1 :1), the required resolution of the spatial light modulators 23 
and 34 may be the same as that of the liquid crystal TV display 22. 

w The picture compressing section and the picture restoring section can use the same spatial light modula- 

tors 23 and 34 and condenser lenses 25 and 32. Accordingly, a complete two-way type picture compressing 
and restoring system can be constructed by applying the same type of optical writing spatial light modulators 
23 and 34 for the liquid crystal TV display 22 and the screen 35 and by integrally forming the light-receiving 
element 26 with the light emitting element 31 , the quantizer 27 with the inverse quantizer 30, encoder 28 with 

15 decoder 29, respectively. 

Fig.6 is a schematic diagram for explaining an example of a space multi-expanding type picture compress- 
ing and restoring system according to the present invention. In Fig.6 showns a two-dimensional lens array (pic- 
ture distributor) 41, a mask for orthogonal transformation (optical multiplication portion) 42, a light-receiving 
element array (optical summation portion) 43, a light source 44, a condenser lens 45, a liquid crystal TV display 

20 46, an orthogonal transform mask 47 and a two-dimensional lens array 48. Other like functioning parts as 
those shown in Fig.S are denoted by like referenced numerals. 

This space multi-expanding method differs from the time multi-expanding method shown in Fig.S in that 
a number of the same original picture images are distributed on a space plane through a two-dimensional array 
of micro-lenses so as to simultaneously and in parallel obtain therefrom orthogonal function expanding coef- 

25 ficients. In other words, the optical operation portion comprising the time-base image-distributing type spatial 
light modulator 23 and the orthogonal function writing device 24 of the time multi-expanding method shown 
in Fig. 5 is exchanged by a parallel operation portion for spatially distributed original images comprising the im- 
age distributor 41 and the orthogonal transformation mask 42 shown in Fig.6. 

The picture compressing section comprises a light source 21, a liquid crystal TV display 22, a two-dimen- 

30 sional array of lenses 41 , an orthogonal transform mask 42, an array of light receiving elements 43, a quantizer 
27 and an encoder 28. 

The mask 42 for orthogonal transformation has blocks wherein a series of orthogonal function patterns 
in the form of corresponding optical density figures are recorded. The original picture shown on the liquid crys- 
tal TV display 22 is projected through the two-dimensional arrayed lenses 41 onto the optical density figures 

35 in the function pattern block (function terms) of the mask 42 and optical multiplications are conducted simul- 
taneously at all blocks of the mask 42. The values of picture elements per block, which are the result of the 
operations per block of the mask 42, are logically summed up on the respective light-receiving elements 43 
(in an array) to get the respective expansion coefficients of the orthogonal functions. A set of function expan- 
sion coefficients corresponding to all blocks of the mask 42 are encoded by the quantizer 27 and the encoder 

40 28. The original picture information is thus compressed. The two-dimensional arrayed lenses 41, mask 42 and 
light-receiving elements 43 can be integrally formed by adhesion. 

The picture restoring section is comprised of a decoder 29, an inverse quantizer 30, a light source 44, a 
condenser lens 45, a liquid crystal TV display 46, a mask for orthogonal transformation 47, a two-dimensional 
array of lenses 48 and a screen 35. A series of the encoded data transmitted from the picture compressing 

45 section are restored by the decoder 29 and the inverse quantizer 30 into the corresponding expansion coef- 
ficients of the orthogonal functions which are then displayed as gradation signals of the respective picture ele- 
ments of the liquid crystal TV display 46. Accordingly, each of the picture elements on the liquid crystal TV 
display 46 is illuminated by the light source 44 and becomes a light source that brightens in accordance with 
the value of the corresponding function expanding coefficient. Each of these light sources is uniform within 

so an area of one element and has a one-to-one correspondence with a corresponding block of the mask 47. 
When light rays from these light sources pass through an image of the orthogonal function patterns recorded 
in the mask 47 for orthogonal transformation, optical multiplications occur parallel and simultaneously on every 
block of the mask 47. The obtained block images are spatially superimposed on each other through the two- 
dimensional array of the lenses 48, thereby the original picture is reproduced on the screen 35. The liquid crys- 

55 tal TV display 46, the mask 47 and the two-dimensional array of lenses 48 can be integrally formed by adhe- 
sion. 

The above-mentioned space multi-expanding method requires a high resolution of the mask 42, 47 for or- 
thogonal transformation to expand the orthogonal function expanding coefficients of the picture image on a 
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two-dimensional plane, i.e.. The masks are each required to record a squared number of picture elements of 
the liquid crystal TV display 22 for displaying the original picture. For instance, in case of getting all DCT coef- 
ficients (326 and 400 pes) for an original picture consisting of 640 horizontal elements and 480 vertical elements 
it is necessary to use orthogonal transformation masks having about 1 x 10 11 picture elements each. If the 
masks are of 100mm in horizontal direction and 75mm in vertical direction, their resolution is 2048 Ip/mm. 

To obtain all DCT coefficients each of the two-dimensional lens arrays 41 and 48 must have the same 
quantity of lenses as the number of picture elements of the liquid crystal TV display 22. However, if the number 
of the orthogonal function expanding coefficients is reduced to 1/10 (by cutting off HF components), the re- 
quired number of picture elements of each orthogonal transformation mask decreases to 1/100. Its resolution 
decreases to 1/10 and the quantity of lenses in a two-dimensional lens array is reduced to 1/10. 

> The picture compressing and picture restoring sections can use the same type of spatial light modulators 
42, 47 and the same type of two-dimensional lens array 41 , 48. Accordingly, a complete two-way type picture 
compressing and restoring system can be constructed by applying the same optical writing type spatial light 
modulators 23 and 34 for the liquid crystal television display 22 and the screen 35 and by integrally forming 
the light-receiving element array 43 with the light source portion (the light source 44, the condenser lens 45 
and the liquid crystal TV display 46), the quantizer 27 with the inverse quantizer 30, the encoder 28 with the 
decoder 29 respectively. 

Fig. 7 is a schematic diagram for explaining an example of a time-and-space multi-expanding type picture 
coding and restoring system according to the present invention. In Fig. 7, 51 is a two-dimensional lens array 
(picture distributor), 52 is a light modulator for orthogonal transformation (optical multiplication portion), 53 is 
a light-receiving element array (optical summation portion), 54 is a light source, 55 is a condenser lens, 56 is 
a liquid crystal TV display, 57 is a mask for orthogonal transformation and 58 is a two-dimensional lens array. 
Other like functioning parts as those shown in Fig. 5 are denoted by like referenced numerals. 

The time multi-expanding method shown in Fig.S is such that all of the orthogonal function expanding coef- 
ficients are obtained within a certain duration of time by conducting optical multiplications one at a time of every 
orthogonal function patterns with a projected (thereto) original picture by means of a spatial light modulator 
which is capable of serially rewriting functional patterns at a high speed. 

The space multi-expanding method shown in Fig. 6 is such that an original picture is evenly projected 
through a two-dimensional array of lenses on all orthogonal function patterns previously recorded in a spatial 
light modulator and optical multiplications upon the original picture with all function patterns conducted in par- 
allel at a time, thereby all expansion coefficients of the orthogonal functions can be obtained at the same time. 

The time-and-space expanding method shown in Fig. 7 is a combination of the above-mentioned two meth- 
ods, which will be explained by way of example in the case that multiplications upon an original picture with 
every orthogonal function pattern must be conducted NxM times to obtain a series of orthogonal function 
expanding coefficients and therefore a spatial light modulator capable of previously recording N pieces of or- 
thogonal function patterns therein and renewing them serially at a high speed is used. 
An original picture is projected evenly and simultaneously onto the N orthogonal function patterns in the spatial 
light modulator through a two-dimensional lens array and optical multiplications are conducted N times in par- 
allel at all orthogonal function patterns in relation to the thereto projected original picture to simultaneously 
get the N pieces of the orthogonal function expanding coefficients. Further, the N pieces of orthogonal pat- 
terns in the spatial light modulator are rewritten into N pieces of successive patterns and multiplications are 
conducted N times in parallel at a time upon all these patterns in relation with the original picture projected 
thereon through the two dimensional lens array. The parallel optical multiplications on N renewable orthogonal 
function patterns are repeated serially by M times to get all (NxM pieces) of required expansion coefficients 
of the orthogonal functions. 

The picture compressing section comprises a light source 21, a liquid crystal TV display 22, a two-dimen- 
sional array of lenses 51 , a spatial light modulator for orthogonal transformation 52, an array of light receiving 
elements 53, a quantizer 27 and an encoder 28. 

The spatial light modulator 52 for orthogonal transformation has blocks wherein a series of orthogonal 
function patterns in the form of corresponding optical density figures are recorded. The original picture shown 
on the liquid crystal TV display 22 is projected through the two-dimensional lens array 51 onto every optical 
density figure in the function pattern blocks (function terms) of the spatial light modulator 52 and optical mul- 
tiplications are conducted in parallel and serially at every block of the spatial light modulator 52. For example, 
in the case that multiplications of orthogonal function patterns in relation to an original picture are performed 
serially from A to D blocks of the spatial light modulator but simultaneously within each block. The values of 
the picture elements, per block, which are logical products of the spatial light modulator 52, are logically sum- 
med up on the respective light-receiving elements 53 (in an array) to get the respective expansion coefficients 
of the orthogonal functions. A set of function expanding coefficients for all the blocks of the spatial light mod- 
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ulator 52 are digitized by the quantizer 27 and the encoder 28. The original picture information is thus com- 
pressed. 

The picture restoring section is composed of a decoder 29, an inverse quantizer 30, a light source 54, a 
condenser lens 55, a liquid crystal TV display 56, a spatial light modulator for orthogonal transformation 57, 

5 a two-dimensional array of lenses 58 and a screen 35. A series of the encoded data transmitted from the picture 
compressing section are restored by the decoder 29 and the inverse quantizer 30 into the corresponding ex- 
pansion coefficients of the orthogonal functions which are displayed, each as gradation signals, at the respec- 
tive picture elements of the liquid crystal TV display 56. Accordingly, each of the picture elements on the liquid 
crystal TV display 56 is illuminated by the light source 54 and becomes a light source that brightens up in ac- 

10 cordance with the value of the expansion coefficient of the functions. Each of these light sources is uniform 
within an area of one element and has a one-to-one correspondence with a corresponding block of the spatial 
light modulator 57. When light rays from these light sources pass through an image of the orthogonal function 
patterns recorded in the spatial light modulator 57 for orthogonal transformation, optical multiplications occur 
parallel and simultaneously at every block of the modulator 57. The obtained block images are spatially su- 

15 perimposed through the two-dimensional array of the lenses 58, thereby the original picture is reproduced on 
the screen 35. 

With this method, it is also possible to construct a complete two-way type picture compressing and re- 
storing system in a similar way as the two preceding methods. 

As previously described, the time multi-expanding method requires the ultra-high speed response of a spa- 
20 tial light modulator for orthogonal transformation, and the space multi-expanding method requires the high 
resolution of both two-dimensional lens array and the orthogonal transformation mask. Accordingly, in case 
of the time-and-space multi-expanding method it is possible to reduce the required response speed and re- 
solution of the components by distributing the orthogonal function expanding coefficients to both time and 
space. 

25 A method for forming orthogonal function patterns will be explained as follows: 

This relates to a system comprising a two-dimensional lens array (picture distributor) and a mask for or- 
thogonal transformation, which are used in the space multi-expanding type shown in Fig. 6, and also to a system 
comprising a two-dimensional lens array (picture distributor) and a spatial light modulator for orthogonal trans- 
formation, which are used in the time-and-space multi-expanding type system shown in Fig. 7. 

30 If the n-th term of an orthogonal function is denoted by R(n), the distortion-free picture distributor has an 

image transmission characteristic (G) of 1 and therefore an orthogonal function pattern to be recorded in the 
spatial light modulator will be expressed as R(n) x (1/G) = R(n) that represents an original orthogonal function 
pattern. 

The pattern forming method which is capable of realizing the same effect as that of the ideal distortionless 
35 image distributor by using an existing image distributor not being free from image distortion, is such that the 
spatial light modulator is forcibly compensating for a distorted image transmission (characteristic G) by giving 
thereto a distortion orthogonal function pattern obtained by multiplying a normal orthogonal function pattern 
by a distortion compensating characteristic, i.e., R(n) x (1/G), where R(n) - the n-th term of the orthogonal 
function system. 

40 Table 1 is a comparison table in which technical specifications of the main devices of the time multi-ex- 

panding system, the space multi-expanding system and the time-and-space multi-expanding system are 
shown for comparison. 
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The time multi-expanding system has no need to use a two-dimensional lens array, a mask for orthogonal 
transformation and an array of light receiving elements, but it needs a light receiving element and a spatial 
light modulator for orthogonal transformation. The most important point of this method is the requirement of 
an ultra-high speed response to the spatial light modulator for orthogonal transformation. 

The space mult-expanding system has no need to use a spatial light modulator for orthogonal transfor- 
mation but it needs a two-dimensional lens array, a mask for orthogonal transformation and a light-receiving 
element array. The most important point of the method is to assure high quality of the image formed by the 
two-dimensional lens array. 

The time-and-space multi-expanding system has no need to use a mask for orthogonal transformation but 
it needs a two-dimensional lens array, a spatial light modulator for orthogonal transformation and an array of 
light-receiving elements. The most important point of the method is to assure an ultra-high speed response to 
the spatial light modulator for orthogonal transformation and a high quality image formed by the two-dimen- 
sional lens array. 
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The above-mentioned three systems may be applied depending upon the required processing speed and 
its application. 



Claims 



1. A picture compressing and restoring system which divides an original picture into small blocks, samples 
each of the blocks by using discrete cosine transform, encodes discrete cosine transform coefficients, 
transmits the encoded coefficients, decodes the encoded values into the discrete cosine transform coef- 
ficients, obtains an intermediate picture image by performing inverse discrete transformation of the coef- 
ficients and restores therefrom the original picture, characterized by being providing with: 

a picture compressing section (11) which includes a multiplication means (12) for storing a series of or- 
thogonal function patterns in the form of varied optical density figures and for performing an optical mul- 
tiplication upon an original picture in relation to the orthogonal function patterns; a summation means (13) 
for obtaining the expansion coefficients of the orthogonal functions for the whole original picture by using 
the multiplication means (12); a quantizing and encoding means (14) for quantizing and encoding the ex- 
pansion coefficients obtained by the summation means (13); and 

a picture restoring section (15) which includes a decoding and an inverse quantizing means (16) for re- 
storing a series of data encoded by the picture compressing section (11) into the expansion coefficients; 
an optical density picture obtaining means (1 7) for obtaining a uniformly bright optical density picture cor- 
responding to the value of an orthogonal function expanding coefficient obtained by the decoding and 
inverse quantizing means (16); a multiplication means (18) for obtaining images of picture elements cor- 
responding to respective expansion coefficients by performing optical multiplications upon the optical 
density picture obtained by the optical density picture obtaining means (17) in comparison with a ortho- 
gonal function pattern recorded in the same way as storing in the picture compressing section (11); and 
a summation means (19) for optically superimposing the images of the picture elements obtained by the 
multiplication means (18). 

2. A picture compressing and restoring system which divides an original picture into small blocks, samples 
each of the blocks by using discrete cosine transform, encodes discrete cosine transform coefficients, 
transmits the encoded coefficients, decodes the encoded values into the discrete cosine transform coef- 
ficients, obtains an intermediate picture image by performing inverse discrete transformation of the coef- 
ficients and restores therefrom the original picture, characterized by being providing with: 

a picture compressing section which includes a masking means (42)(52) for storing a series of orthogonal 
function patterns in the form of varied optical density figures and for performing an original picture into 
orthogonal function patterns by performing parallel and sequential multiplications upon the original picture 
in comparison with the patterns of the orthogonal functions; a picture distributor (41)(51) for projecting 
the original picture onto all the orthogonal function patterns of the masking means (42)(52), an array of 
light-receiving elements (43)(53) for obtaining orthogonal function expansion coefficients for the total orig- 
inal picture from the multiplication products of the masking means (42)(52); and a quantizing and an en- 
coding device (27)(28) for quantizing and encoding the expansion coefficients obtained by the light- 
receiving element array (43)(53); 
and 

a picture restoring section which includes a decoding and an inverse quantizing device (29)(30) for re- 
storing a series of data encoded by the picture compressing section into the expansion coefficients; an 
indicator (46)(56) serving as a source of light corresponding to the value of the orthogonal function ex- 
panding coefficient obtained by the decoding and inverse quantizing device (29)(30); a masking means 

(47) (57) for recording orthogonal function patterns and for light performing parallel and sequential multi- 
plications upon passing therethrough from the light source (44)(54); and a two-dimensional lens array 

(48) (58) for superimposing on time and space pictures obtained by the masking means (47)(57). 

3. A picture compressing and restoring system according to Claim 2, wherein said masking means is a spatial 
light modulator. 

4. A method for forming a pattern recordable in the spatial light modulator of a picture compressing and re- 
storing system wherein an original picture is projected by a picture distributor onto a spatial light modulator 
and optical multiplications are performed by comparing the original picture with a picture recorded in the 
spatial light modulator, characterized in that the pattern of a distorted orthogonal function pattern, ob- 
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tainable by multiplying a normal orthogonal function pattern by a distorted compensating characteristic 
instead of a normal orthogonal function pattern is applied to the spatial light modulator (42)(52) to com- 
pensate for the distorted characteristic of the picture distributor (41)(51). 



5 5. A picture compression and restoring means according to Claim 2 or 3, wherein said picture distributor (41) 
(51), said masking means (42) (52) and said array of light receiving elements (43) (53) are formed inte- 
grally. 

6. A picture compression and restoring means according to Claim 2 t 3 or 5, wherein said indicator (46) (56), 
10 said masking means (47) (57) and said two-dimensional lens array (48) (58) are formed integrally. 

7. A picture compression and restoring means according to Claim 2, 3, 5 or 6, wherein said light source (44) 
(54) is used in conjunction with a condensing lens (45) (55). 
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